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(54) Video encoder/decoder with scrambling functions 



(57) In a compression coding device having a 
scrambling function, a variable length coder (220) out- 
puts coded image data. When the image data are to be 
written to a memory (222a) included in a multiplexer 
(222), a controller (242) generates a control signal for 
writing the image data in the order of the positions of 
slices constituting a single picture, and feeds it to the 
memory (222a). When the image data should be scram- 
bled on the basis of a preselected scrambling system, 
the controller (242) outputs a control signal for reading 
the image data out of the memory (222a) in a different 
order with respect to the positions of slices, and feeds it 



to the memory. TTie multiplexer (222) multiplexes the 
image data in a preselected position of an MPEG (Mov- 
ing Picture Experts Group) 2 output data format Fur- 
ther, the controller (242) outputs information 
representative of the positions of the slices occurred 
before and after the scrambling, and causes the multi- 
plexer (222) to multiplex them in another preselected 
position of the MPEG2 output data format. An expan- 
sion reproducing device having a descrambling function 
is also disclosed. 




?42 FIG.l 



CONTROLLER 



„ CJXk !j 

^.jtHn*^—^ 

J139SL 



»i — rfZK >_ .... 

>-332 



ISCBTRACTER 

w 



342 



346, 



DCTCKT 



-332 



QUANTIZES 

^216 
y-340 



an 



VARIABLE 

iC — 

Dl 



DEQUANTEZER 



ileI £ 



^"376 



^T350 



y 378 




INVERSE 
DCTCKT 



ADDER 



-228 



MULTIPLEXER 



354 



356 
DOUT 



112 



MEMORY 



222m 



"\-230 



^N37g 132 JRD SWITCH 



V -350 



222 



"352 



Q. 
LU 



Printed by Rank Xarax (UK) Business Services 
2.14.18/3.4 



EF000805599 rfile://S:\PATENT FILESWixs System s ( 1459 JGDWIXS Patents \ViXS 010C\Referen ces \EP0008055 99.cpcl 



Pag e 2 of 6f 



1 EPO 

Description 

BACKGROUND OF THE INVENTION 

Field of the Invention 

The present invention relates to a compression 
coding device having a scrambling function, and an 
expansion reproducing device having a descrambling 
function. More particularly, the present invention is con- 
cerned with a compression coding device adaptive to 
the MPEG (Moving Picture Experts Group) 2 standard 
and capable of scrambling and coding data, and an 
expansion reproducing device also adaptive to the 
MPEG 2 standard and capable of descrambling and 
decoding the data scrambled by the coding device. 

Description of the Background Art 

In Japan, for example, scrambled broadcasting 
using a broadcasting satellite (BS) started in 1991 while 
broadcasting using a communication satellite (CS) 
started in 1992 and was scrambled like BS broadcast- 
ing. It is a common practice with BS or CS television 
broadcasting to scramble analog video signals by a line 
permutation (scanning line transfer) system, line rota- 
tion (intra-line signal switching) system, Skyport sys- 
tem, video cypher system, B-MAC system or similar 
system. 

The line permutation system changes the order of 
scanning lines. The line rotation system provides a cut 
point or cut points in the individual scanning line and 
replaces the segments divided by the cut point or 
points. The Skyport system replaces all the scanning 
lines at random. The video cypher system removes syn- 
chronizing signals from a video signal, and at the same 
time, reverses the polarity. Further, the B-MAC system 
varies the length of the individual scanning line at ran- 
dom. 

With the advent of full-scale multimedia environ- 
ments handling speech, data and image (picture) totally, 
ISO (International Organization for Standardization) is 
standardizing various kinds of information compression 
technologies constituting the heart of multimedia. 
Recently, ISO has standardized MEPG1 as a moving 
picture coding system for storage and directed toward 
CD-ROMs (Compact Disk Read Only Memories) and 
other storage media. Later, ISO has standardized 
MPEG2 applicable not only to storage media but also to 
communication and broadcasting media. 

A compression coding device adaptive to MPEG2 
produces an I picture (Intra-Picture) for a preselected 
frame or picture of an input moving picture by using, 
e.g., an intra-frame/intra-field coding system. The cod- 
ing system produces a P picture (Predictive-Picture) for 
a single preselected picture different from the I picture 
by using interframe/interfield forward predictive coding 
system. Further, the coding system produces a B pic- 
ture (Bidirectionally Predictive-Picture) for preselected 
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two pictures different from the I and P pictures by using 
a bidirectionally predictive coding system. The I, P and 
B pictures, or coded or compressed data, are repeat- 
edly output in the order of, e.g., GOPs (Group-Of-Pic- 
5 tures) shown in FIG. 13B. The coded data output in 
such an order are, e.g., digitally modulated and broad- 
cast via a BS. 

To reproduced the BS broadcast coded data on a 
monitor, use is made of an expansion reproducing 

w device adaptive to MPEG2. The reproducing device 
decodes the coded data received from a satellite and 
transforms the decoded data to a signal which can be 
displayed by the monitor. 

However the problem with the conventional coding 

is device adaptive to MPEG2 is that the coded data are 
not scrambled despite that the broadcast is chargeable. 
As a result, any person can decoded the coded data 
and enjoy a moving picture based on the decoded data 
on, e.g., a monitor for free only if the person has the 

20 expansion reproducing device at hand. 

SUMMARY OF THE INVENTION 

It is therefore an object of the present invention to 

25 provide a compression coding device capable of output- 
ting scrambled coded data, and an expansion reproduc- 
ing device capable of descrambling and decoding the 
coded data received from the coding device. 

In accordance with the present invention, a com- 

30 pression coding device for handling a single picture or a 
preselected plurality of pictures as a single group of pic- 
tures, and coding digital image data representative of 
the individual picture included in the single group of pic- 
tures, and having a scrambling function includes a 

35 coder for coding the image data representative of the 
individual picture to thereby output coded image data. A 
memory stores the coded image data output from the 
coder. A multiplexer multiplexes the coded image data 
read out of the memory a preselected position of an out- 

40 put data format A controller controls the coder, memory 
and multiplexer on the basis of a preselected scram- 
bling system. The image data representative of the indi- 
vidual picture are divided into a plurality of slices each 
being subdivided into a plurality of macroblocks. The 

45 controller generates, when writing the coded image 
data in the memory, a control signal for writing the 
coded image data in the order of the positions of the 
slices, from the top to the bottom as seen on a picture, 
constituting the individual picture, and feeds the control 

so signal to the memory. The controller generates, when 
scrambling the coded image data on the basis of the 
preselected scrambling system, a control signal for 
reading the coded image data in the order of the slices 
different from the order of writing to thereby output 

55 scrambled coded image data, feeds the control signal to 
the memory thereby cause the multiplexer to multiplex 
the scrambled coded image data fed thereto in the 
preselected position of the output data format, gener- 
ates information representative of positions of the slices 
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occurred before and after the scrambling, and feeds the 
information to the multiplexer as control data to thereby 
cause the multiplexer to multiplex the control data in a 
preselected position of the output data format. 

Also, in accordance with the present invention, an s 
expansion reproducing device includes a demultiplexer 
for receiving a signal containing image data and control 
data from the multiplexer included in the above com- 
pression coding device for separating the signal into the 
image data and control data. A memory stores the 10 
image data output from the demultiplexer. A decoder 
decodes the image data read out of the memory. A con- 
troller controls the demultiplexer, memory and decoder 
in accordance with the control data output from the 
demultiplexer. The controller generates, when storing js 
the image data output from the demultiplexer in the 
memory, a control signal for writing the image data in 
the order of slices representative of the individual pic- 
ture and each consisting of a plurality of macroblocks. 
and feeds the control signal to the memory. The control- 20 
ler generates, when received information contained in 
the control data and representative of the positions of 
the slices occurred before and after scrambling, a con- 
trol signal for reading the image data in the order of the 
positions of the slices occurred before the scrambling, 25 
but from the positions of the slices occurred after the 
scrambling, and feeds the control signal to the memory 
thereby cause descrambled image data to be output 
from the memory. 

30 

BRIEF DESCRIPTION OF THE DRAWINGS 

The objects and features of the present invention 
will become more apparent from the consideration of 
the following detailed description taken in conjunction 35 
with the accompanying drawings in which: 

FIG. 1 is a schematic block diagram showing, when 
combined with FIG. 2, a compressing coding device 
embodying the present invention and- having a 40 
scrambling function; 

FIG. 2 is a schematic block diagram showing the 
embodiment when combined with FIG. 1 ; 
FIG. 3 shows how FIGS. 1 and 2 are combined; 
FIG. 4 shows how FIGS. 5 and 6 are combined; 45 
FIG. 5 is schematic block diagram showing, when 
combined with FIG. 6, an expansion reproducing 
device also embodying the present invention and 
having a descrambling function; 
FIG. 7 is a block diagram schematically showing a so 
specific system configuration in which the compres- 
sion coding device and expansion reproducing 
device are connected; 

FIG. 8 is a schematic block diagram showing a spe- 
cific configuration of an analog-to-digital converter ss 
included in the circuitry of FIG. 2; 
FIG. 9 is a schematic block diagram showing a spe- 
cific configuration of a preprocessor also included 
in the circuitry of FIG. 2; 
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FIG. 10 demonstrates a specific procedure for the 
preprocessor to deal with a luminance signal; 
FIG. 1 1 demonstrates a specific procedure for the 
preprocessor to deal with two different chromi- 
nance signals; 

FIG. 12 shows the structure of GOP data particular 
to the embodiment shown in FIGS. 1 and 2; 
FIGS. 13A-13E show how the coding device and 
decoding device each process pictures, and the 
arrangement of pictures; 

FIG. 14 shows the hierarchical structure of image 
data particular to the embodiment shown in FIGS. 1 
and 2; 

FIG. 15 shows specific positions of slices constitut- 
ing a single picture and not subjected to scrambling 
by the embodiment shown in FIGS. 1 and 2; 
FIG. 16 shows specific positions of the slices 
shown in FIG. 15 and subjected to scrambling; 
FIG. 17 shows other specific positions of the slices 
not subjected to scrambling; 
FIG. 18 shows other specific positions of the slices 
subjected to scrambling; 

FIGS. 19 A, 19B and 19C show, when combined as 
shown in FIG. 19, a part of the hierarchical struc- 
ture of data output from the coding device shown in 
FIGS. 1 and 2; 

FIGS. 20A, 20B, 20C and 20D show, when com- 
bined as shown in FIG. 20, another part of the hier- 
. archical structure; 
FIGS. 21 A, 21 B. 21C and 21 D show, when com- 
bined as shown in FIG. 21 , show still another part of 
the hierarchical structure; 
FIGS. 22A, 22B and 22C show, when combined as 
shown in FIG. 22, the contents of a part of abbrevi- 
ations shown in FIGS. 19A-19C; 
FIGS. 23A, 23B and 23C show, when combined as 
shown in FIG. 23, the contents of another part of 
the abbreviations; 

FIGS. 24A, 24B and 24C show, when combined as 
shown in FIG. 24, the contents of another part of 
the abbreviations; 

FIGS. 25A, 25B and 25C show, when combined as 
shown in FIG. 25, the contents of another part of 
the abbreviations; 

FIGS. 26A, 26B and 26C show, when combined as 
shown in FIG. 26, the contents of another part of 
the abbreviations; 

FIGS. 27A, 27B and 27C show, when combined as 
shown in FIG. 27, the contents of another part of 
the abbreviations; and 

FIGS. 28A and 28B show, when combined as 
shown in FIG. 28, the contents of the rest of the 
abbreviations. 

DESCRIPTION OF THE PREFERRED EMBODI- 
MENTS 

Referring to FIG. 7 of the drawings, a specific sys- 
tem configuration including a compression coding 
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device 1 with a scrambling function and an expansion 
reproducing device 2 with a descrambling function in 
accordance with the present invention is shown. The 
coding device 1 and reproducing device 2 are applica- 
ble to, e.g., a digital BS broadcasting system for moving 5 
pictures adaptive to MPEG2. As shown, a video camera 
3 sequentially sends an NTSC (National Television Sys- 
tem Committee) moving picture to the coding device 1 . 
The coding device 1 codes and scrambles the moving 
picture frame by frame, or picture by picture, while feed- . 10 
ing the resulting scrambled compressed image data to a 
transmitter/receiver 4 for satellite broadcasting. The 
transmitter/receiver 4 demodulates the compressed 
image data and delivers them to the reproducing device 
• 2. The reproducing device 2 descrambles and decodes 75 
the demodulated image data and thereby reproduces 
an NTSC video signal based on the decoded data. The 
video signal representative of the moving picture is out- 
put to a monitor 5, 

In the illustrative embodiment, the coding device 1 20 
includes a scramble button circuit 244. When a button 
included in the scramble button circuit 244 is pressed, 
the coding device 1 scrambles the coded data of the 
moving picture picture by picture. The scrambled image 
data are fed to the reproducing device 2 via the trans- 25 
mitter/receiver 4, as stated above. In the embodiment, 
the reproducing device 2 has a descramble button cir- 
cuit 430 including a button. When the button of the cir- 
cuit 430 is pressed, the reproducing device 2 
descrambles the compressed image data received from 30 
the transmitter/receiver 4 and delivers the descrambled 
data to the monitor 5. In this condition, a picture identi- 
cal with the moving picture output from the camera 3 
appears on the monitor 5. If the button of the descram- 
ble button circuit 430 is not pressed, the moving picture 35 
output from the camera 3 does not appear on the moni- 
tor 5 because it is not descrambled. 

Assume that neither the button of the button circuit 
244 nor the button of the button circuit 430 is pressed. 
Then, the coding device 1 feeds non-scrambled coded 40 
image data to the reproducing device 2. In response, 
the reproducing device 2 decodes the non-scrambled 
coded image data and feeds the resulting data to the 
monitor 5. In this case, a picture identical with the mov- 
ing picture output from the camera 3 appears on the 45 
monitor 5. 

The coding device 1 is connected to the video cam- 
era 3 and transmitter/receiver 4. The camera 3 outputs 
an NTSC video signal in the illustrative embodiment. 
The transmitter/receiver 4 broadcasts or receives the so 
compressed image data output from the device 1. The 
transmitter/receiver 4 is connected to the reproducing 
device 2 which is in turn connected to the monitor 5. The 
monitor 5 displays the NTSC video signal output from 
the device 2 and is connected to the camera 3 also. If ss 
desired, the devices 1 and 2 may be directly connected 
without the intermediary of the transmitter/receiver 4. 

More specifically, the camera 3 and coding device 1 
are connected to each other by four signal lines 102, 



104, 106 and 108. The camera 3 has output terminals 
YOUT, GrOUT. CbOUT and SYOUT respectively 
assigned to a luminance signal Y, a chrominance signal 
R-Y, a chrominance signal B-Y, and synchronizing sig- 
nals. The coding device 1 has input terminals YIN, CrlN, 
CbIN and SYIN respectively connected to the output 
terminals YOUT-SYOUT of the camera 3 by the signal 
lines 102-108. In this configuration, the camera 3 deliv- 
ers an analog luminance signal Y, two analog chromi- 
nance signals Cr and Cb and synchronizing signals to 
the coding device 1 via the signal lines 102-108, respec- 
tively. The synchronizing signals include a horizontal 
synchronizing signal, a vertical synchronizing signal, 
and a color subcarrier signal. The camera 3 additionally 
includes an output terminal VSOUT connected to a first 
video signal input terminal VSIN-1 included in the mon- 
itor 5 via a signal line 1 10. The NTSC video signal out- 
put from the camera 3 is fed to the monitor 5 via the 
signal line 110. 

The coding device 1 includes a compressed image 
data output terminal DOUT connected to a compressed 
image data input terminal DIN included in the transmit- 
ter/receiver 4 by a signal line 112. In the illustrative 
embodiment, the coding device 1 feeds to the transmit- 
ter/receiver 4 the scrambled signal having the format 
prescribed by MPEG2. The transmitter/receiver 4 
includes a compressed image data output terminal 
DOUT connected to a compressed data input terminal 
DIN included in the reproducing device 2 by a signal line 
1 14. In the embodiment, the transmitter/receiver 4 feeds 
the demodulated and scrambled signal having the 
above format to the reproducing device 2. The repro- 
ducing device 2 descrambles and decodes the input 
image data, generates an NTSC video signal based on 
the decoded data, and then outputs the video signal via 
the output terminal VSOUT. This video signal is applied 
to a second video signal input terminal VSIN-2 included 
in the monitor 5 via a signal line 116. FIGS. 1 and 2 
show, when combined as shown in FIG. 3, the coding 
device embodying the present invention. Likewise, 
FIGS. 5 and 6 show, when combined as shown in FIG. 
4, the reproducing device 2 also embodying the present 
invention. 

As shown in FIGS. 1 and 2, the coding device 1 has 
an analog-to-digital converter (ADC) 202, a preproces- 
sor 204, a first frame memory 206, a first switch 208, a 
second frame memory 210, a second switch 212, a sub- 
tracter 214, a DCT (Discrete Cosine Transform) circuit 
216, a quantizer 218, a variable length coder 220, a 
multiplexer 222, a dequantizer 226, an inverse DCT cir- 
cuit 228, an adder 230, a third switch 232, a first predic- 
tor 234, a second predictor 236, a mean circuit 238, a 
fourth switch 240, a controller 242, and the scramble 
button circuit 244 mentioned earlier. The dequantizer 
226, inverse DCT circuit 228, adder 230, third switch 
232, first and second predictors 234 and 236, mean cir- 
cuit 238 and fourth switch 240 constitute a local decoder 
in combination. 

As shown in FIG. 8, the ADC 202 is made up of a Y 
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ADC circuit 202a, a Cr ADC circuit 202b, and a Cb ADC 
202c. The analog luminance signal Y output from the 
camera 3 is fed to the input of the Y ADC circuit 202 via 
the input terminal YIN of the coding device 1 and a sig- 
nal line 102. In the illustrative embodiment, the lumi- 
nance signal Y has 240 valid scanning lines for a field. 
The ADC circuit 202a transforms the luminance signal Y 
to corresponding digital data. Specifically, while the con- 
troller 242 feeds a sampling signal to the ADC circuit 
202a via a control line 308, the ADC circuit 202a digi- 
tizes the luminance signal Y at a rate of 704 dots for a 
scanning line except for a blanking period, and eight bits 
for a pixel. In the embodiment, the sampling signal out- 
put from the controller 242 has a frequency of 13.5 
MHz. 

The analog chrominance signal Cr output from the 
camera 3 is applied to the input of the Cr ADC circuit 
202b via the input terminal CrIN of the coding device 1 
and a signal line 104. In the illustrative embodiment, the 
chrominance signal Cr has 240 valid scanning lines for 
a field. The ADC circuit 202b transforms the chromi- 
nance signal Cr to corresponding digital data. Specifi- 
cally, while the controller 242 feeds a sampling signal to 
the ADC circuit 202b via the control line 308, the ADC 
circuit 202b digitizes the chrominance signal Cr at a rate 
of 352 dots for a scanning line except for a blanking 
period, and eight bits for a pixel. In the embodiment, the 
sampling signal output from the controller 242 has a fre- 
quency of 6.75 MHz. 

Further, the analog chrominance signal Cb output 
from the camera 3 is applied to the input of the Cb ADC 
circuit 202c via the input terminal CbIN of the coding 
device 1 and a signal fine 106. In the illustrative embod- 
iment, the chrominance signal Cb also has 240 valid 
scanning lines for a field. The ADC circuit 202c is iden- 
tical in construction and operation with the ADC circuit 
202b except for the kind of a signal to deal with. As the 
above sampling frequency indicates, this embodiment 
codes 4:2:2 pictures prescribed by ITU (International 
Telecommunication Union)-R Recommendation 601. 

As shown in FIG. 9, the preprocessor 204 has a Y 
frame memory 204a, a Cr frame memory 204b, and a 
Cb frame memory 204c. The ADC circuits 202a, 202b 
and 202c have outputs 302, 304 and 306, respectively. 
The outputs 302-306 are respectively connected to the 
inputs of the Y, Cr and Cb frame memories 204a-204c. 
It is to be noted that the chrominance signals Cb and Cr 
are respectively produced by Cb = B (blue) - Y (lumi- 
nance signal) and Cr = R (red) - Y (luminance signal). 

In the embodiment, the preprocessor or signal 
processing circuit 204 sequentially receives a first and a 
second field from the ADC 202 at a field period, forms a 
single frame based on the first and second fields, and 
then outputs the frame at a frame period. One frame 
output from the preprocessor 204 has parameters iden- 
tical with an NTSC format (704 pixels x 480 lines) used 
by MPEG2. Processing to be executed by the preproc- 
essor 204 is demonstrated in FIGS. 10 and 11. While 
the preprocessor 240 is shown as transforming an 



NTSC video signal to an NTSC format, it may receive, 
e.g., a PAL (Phase Alternation Line) video signal and 
transform it to a PAL format or any other suitable format. 
The NTSC signal has 525 scanning lines of which 480 

5 scanning lines are valid. The PAL signal has 625 scan- 
ning lines of which 576 scanning lines are valid. 

Referring to FIG. 9, the Y frame memory 204a is 
implemented by, e.g., a RAM (Random Access Mem- 
ory) (D (Dynamic) RAM). In the embodiment, the frame 

10 memory 204a sequentially receives from the ADC cir- 
cuit 202a two fields of Y data, i.e., a first and a second 
field respectively constituted by odd lines and even 
lines. The two fields constitute one frame. The one 
frame of Y data are sequentially written to the frame 

75 memory 204a in the order of line and read thereoutof in 
the order of line. The Cr frame memory 204b and Cb 
frame memory 204c are identical in construction and 
operation with the Y fame memory 204a except that 
they receive one frame of Cr data and one frame of Cb 

20 data from the ADC circuits 202b and 202c, respectively. 
For the writing and reading of the data, the controller 
242 feeds a write control signal and a read control sig- 
nal to the frame memories 204a-204c via a control line 
310. The frame memories 204a-204c have their outputs 
.25 312, 314 and 316 connected to the corresponding 
inputs of the first frame memory 206, FIG. 2. In the illus- 
trative embodiment, the data are read out frame by 
frame because the coding device 1 handles one frame 
as a unit. When one field is dealt with as a unit, the data 

30 may be read out frame by frame. 

In the illustrative embodiment, image data repre- 
sentative of each picture other than I pictures are pro- 
duced on the basis of the preceding and following 
picture data, i.e., a single picture does not provide com- 

35 plete information. In addition, for reproduction, storing 
and broadcasting media need various trick modes 
including a fast forward mode and a rewind mode. 
Under these circumstances, the embodiment, like 
MPEG1 and 2, adopts a structure in which some picture 

40 data or frame data are collectively handled as a GOP 
(Group of Pictures), as shown in FIG. 12. The number of 
pictures or frames (N) constituting a single GOP is open 
to choice although the maximum number is around fif- 
teen. In this embodiment, the number N is selected to 

45 be nine by way of example. For this reason, the first 
frame memory 206, FIG. 2, has a capacity capable of 
accommodating nine frames of data. 

The first frame memory 206, implemented as a 
DRAM in the embodiment, is capable of storing nine 

so frames of data Y, Cr and Cb, as mentioned above. Spe- 
cifically, a first to a ninth frame memory constitute a 
frame memory assigned to the data Y. The frame-by- 
frame Y data output from the preprocessor 204 are 
sequentially repeatedly written to the first to ninth frame 

55 memories in this order. Frame memories assigned to 
the data Cr and Cb, respectively, may be identical in 
configuration and operation with the frame memory 
assigned to the data Y For the writing of such data, the 
controller 242 feeds a write control signal to the frame 
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memory 206 via a control line 320. The data stored in 
the frame memory 206 may be read out at a timing one 
frame later than the write timing; in the embodiment, the 
data Y, Cb and Cr may be repeatedly read out in this 
sequence, and out of the first to ninth frame memories 5 
in this order. For the reading of the data, the controller 
242 also feeds a read control signal via the control line 
320. rThe data read out in such an order sequentially 
appear on an output 318. The output 318 of the frame 
memory 206 is connected to the corresponding inputs ?o 
of the first and second switches 208 and 212. Again, the 
data are read out frame by frame because the coding 
device 1 handles one frame as a unit. When one field is 
dealt with as a unit, the data may be read out frame by 
frame. 15 

The first switch 208 selectively connects the input 
318 to its output 319 (ON) or disconnects the former 
from the latter (OFF) under the control of a control sig- 
nal 322 fed from the controller 242. In the illustrative 
embodiment, the switch 208 is brought to its ON state 20 
when the coding device 1 generates a B picture or 
brought to its OFF state when the device 1 generates an 
I picture or a P picture. Specifically, when two frames of 
consecutive data for generating a B picture, e.g., pic- 
tures B0 and B1 or pictures B3 or B4 shown in FIG. 13A 25 
are to be read out of the frame memory 206, the switch 
208 is brought to its ON state. On the other hand, when 
a picture for generating an I picture, e.g., 12 or a picture 
for generating a P picture, e.g., P5 is to be read out of 
the frame memory 21 0, the switch 208 is brought to its 30 
OFF state. The output 319 of the switch 208 is con- 
nected to the input of the second frame memory 210. 
Therefore, the second frame memory 210 stores two 
frames of image data for generating a B picture. 

While the optimal period (M) at which the I or P pic- 35 
ture appears depends on the movement of the moving 
image, the period M is selected to be "3", as will be seen 
with reference to FIGS. 13A-13E. That is, two B pictures 
appear during such a period. The second frame mem- 
ory 210 therefore has a capacity corresponding to two 40 
frames. However, the above period M is only illustrative. 

The second frame memory 210 is made up of a Y 
frame memory, a Cr frame memory, and a Cb frame 
memory capable of storing two frames of Y ( Cr or Db 
data each, although not shown specifically. The Y frame 45 
memory consists of a first and a second frame memory. 
The two frames of Y data sequentially fed from the first 
switch 208 are sequentially repeatedly written to the first 
and second frame memories. This is also true with the 
Cr and Cb frame memories. For the writing of the data so 
in the memories, the controller 242 delivers a write con- 
trol signal via a control line 326. 

The data are read out of the second frame memory 
210 when a B picture is coded. The first B picture, e.g., 
B0 in FIG. 13A and the next picture B1 are read out of 55 
the first and second frame memories, respectively. For 
the reading of the data out of the memories, the control- 
ler 242 delivers a read control signal via the control line 
326. The output 324 of the frame memory 210 is con- 



nected to the corresponding input of the second switch 
212. 

The second switch 212 selectively connects one of 
its two inputs 318 and 324 to its output 330 under the 
control of a control signal 331 fed from the controller 
242. In this embodiment, the switch 212 selects the 
input 318 when an I or a P picture is to be generated or 
selects the input 324 when a B picture is to be gener- 
ated. The output 330 is connected to the input of the 
subtracter 214. 

The illustrative embodiment causes the subtracter 
214, which will be described later, to produce a differ- 
ence between the signal value of a given picture and the 
signal value of another picture (past picture or future 
picture as in MPEG1 or 2), i.e., the embodiment adopts 
a prediction coding scheme. Specifically, the embodi- 
ment executes intra-frame prediction coding, forward 
interframe prediction coding, and interpolation (bidirec- 
tional) interframe prediction coding. The intra-frame 
prediction coding is used to produce an I picture without 
using data stored in two prediction memories, i.e., the 
first and second predictors 234 and 236 in the embodi- 
ment. The forward interframe prediction coding is used 
to generate a P picture by using the data stored in the 
first predictor 234 or the second predictor 236. The 
interpolation interframe prediction coding is used to 
generate a B picture by producing a mean of the forward 
interframe prediction and backward interframe predic- 
tion, i.e., by causing the mean circuit 238 to produce a 
mean of the data output from the first and second pre- 
dictors 234 and 236. As for a P picture, the intra-frame 
prediction coding will sometimes be used for portions 
whose unit is a macroblock which will be described 
later. Also, as for a B picture, the intra-frame prediction 
coding, forward interframe prediction coding and back- 
ward interframe prediction coding will sometimes be 
used for portions whose unit is a macroblock. 

Assume that an I picture is to be produced, i.e., 
intra-frame coding is to be executed. Then, in the illus- 
trative embodiment, the subtracter 214 subtracts a data 
value H 0" fed from the fourth switch 240, which will be 
described, from a data value 330 fed from the frame 
memory 206 for I picture generation and representative 
of one picture (e.g., 12, FIG. 13A). The pixel data value 
"0" does not use the above two prediction memories. In 
this case, the data received from the memory 206 are 
directly fed out via the output 336. If desired, the sub- 
tracter 214 may directly deliver the input data 330 via its 
output 336, omitting the subtraction. 

To general a P picture, i.e., to execute the forward 
interframe coding, the subtracter 214 receives from the 
frame memory 206 a data value 330 for the generation 
of a P picture and representative of one picture (e.g. P5, 
FIG. 13A). The subtracter 214 subtracts from the data 
value 330 a data value 332 received from the first pre- 
dictor 234 or the second predictor 236 via the fourth 
switch 240 and appeared a preselected number of 
frames later (12, FIG. 13A, appeared three frames later). 
This subtraction is effected with pixels of the same posi- 
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tion. The result of subtraction appears on the output 
336. 

Further, to generate a B picture, i.e., to execute the 
bidirectional prediction coding, the subtracter 214 
receives from the frame memory 206 a data value 330 
for the generation of a B picture and representative of 
one picture (e.g. B3, FIG. 13A). The subtracter 214 sub- 
tracts from the data value 330 a data value 332 received 
from the mean circuit 238 via the fourth switch 240, i.e., 
a mean of a picture appeared a preselected number of 
frames earlier (P5 ( FIG. 13 A, appeared two frames ear- 
lier) and a picture appeared a preselected number of 
frames later (12, FIG. 13 A, appeared one frame later). 
This is also effected with pixels of the same position. 
The result of subtraction appears on the output 336. In 
any case, the subtraction is controlled by a control sig- 
nal 334 fed from the controller 242. 

More specifically, for the above subtraction, a mac- 
roblock (MB) a (16 pixels x 16 pixels) included in one 
picture, as shown in FIG. 14, is dealt with as a unit. As 
also shown in FIG. 14, each macroblock is subdivided 
into blocks each having 8x8 pixels. Spatial information 
compression using DCT, which will be described later, is 
executed by using such a block as a unit DCT is applied 
to four blocks of the luminance signal Y (Y-j, Y 2 , Y 3 and 
Y 4 ), two blocks of the chrominance signal Cr (Cr 1 and 
Cr 2 ), and two blocks of the chrominance signal Cb (Cb 1 
and Cb2). The output 336 of the subtracter 214 is con- 
nected to the input of the DCT circuit 216. 

The DCT circuit 216 includes a memory, not shown, 
for temporarily storing the above eight blocks of pixel 
data constituting a single macroblock. The DCT circuit 
216 writes, under the control of a control signal 338 fed 
from the controller 242, such macroblocks of pixel data 
sequentially received from the subtracter 214 in the 
memory. Also, under the control of the control signal 
338, the DCT circuit 216 reads the pixel data out of the 
memory block by block. At the same time, the DCT cir- 
cuit 216 executes DCT, or bidimensional orthogonal 
transform, with the individual block of pixel data. As a 
result, the image data lying in the space domain are 
transferred to data lying in the frequency domain, i.e., 
transform coefficients. The transform coefficients are 
fed to the quantizer 218 via an output 340. In this case, 
the transform coefficients Y 1( Y 2 , Y 3t Y 4 , Cb 1( Cfc^, Cr 1 
and Cr 2 are sequentially delivered in this order. 

The quantizer 218 normalises the transform coeffi- 
cients of the individual block under the control of a con- 
trol signal 342 fed from the controller 242, i.e., 
sequentially divides the transform coefficients by a 
quantizing step, from a low frequency component to a 
high frequency component. The normalized transform 
coefficients are sequentially applied to the variable 
length coder 220 and dequantizer 226 via an output 
344. The dequantizer 226 plays the role of a local 
decoder. 

The variable length coder 220 transforms the nor- 
malized transform coefficients to run-lengths and Huff- 
man codes under the control of a control signal 346 fed 



from the controller 242. The resulting data appear on an 
output 348. In this manner, the DCT circuit 2 1 6 performs 
adaptive DCT with the image data. The output 348 is 
connected to the input of the multiplexer 222. 

5 The demultiplexer 222 includes a memory circuit 
222a (DRAM in the embodiment) necessary for scram- 
bling the variable length code data received from the 
variable length coder 220. The memory circuit 222a has 
a capacity great enough to store two frames of data Y, 

10 Cb and Cr although it may be capable of storing three or 
more frames. Specifically, in the embodiment, the mem- 
ory circuit 222a is implemented as a first and a second 
frame memory. The coded data Y, Cb and Cr sequen- 
tially received from the coder 220 are repeatedly written 

is to the first and second frame memories in this order. 
While the data are written to the first frame memory, the 
data are read out of the second memory. Likewise, while 
the data are written to the second frame memory, the 
data are read out of the first frame memory. Such a pro- 

20 cedure is controlled by a write/read control signal fed 
from the controller 242 via a control line 354. 

More specifically, in the illustrative embodiment, the 
data are written to the above frame memories in the 
order of, e.g., slice (see c, FIG. 14) on the picture and in 

25 the order of macroblocks constituting the individual 
slice. The data are read out of the frame memories in a 
preselected order of slice and in the order of macrob- 
lock constituting the slices. In this case, each slice is a 
minimum unit in the form of a sequence of data includ- 

30 ing a slice start code (SSC. FIG. 26C). In this embodi- 
ment, the sequence of data is a strip of macroblocks 
having a width of sixteen pixels. The slice does not 
extend over adjoining lines in the MPEG2 format or over 
adjoining pictures (frames) in the MPEG1 format. The 

35 writing and reading procedures will be described in 
detail with reference to FIGS. 15 and 16. 

For the simplicity of description, FIG. 15 shows a 
single MPEG2 picture consisting of eight consecutive 
slices or lines. When the picture of FIG. 1 5 is scrambled, 

40 a picture shown in FIG. 1 6 and consisting of eight slices 
or lines are output from the coding device 1. In this 
case, the data Y, Cb and Cr are sequentially written to 
the frame memories from the top slice to the bottom 
slice of FIG. 15, i.e., slices A, B t C, D, E, F, G and H and 

45 in the order of macroblocks. The data Y, Cb and Cr are 
sequentially read out of the frame memories in the order 
of slices C, B, D. A, E, H, G and F shown in FIG. 16 and 
in the order of macroblocks constituting the individual 
slice. The scrambled signal is fed to the monitor 5 via 

50 the reproducing device 2 which will be described. How- 
ever, unless the scrambled signal is descrambled by the 
reproducing device 2, the expected picture does not 
appear on the monitor 5 because the position of the pic- 
ture output from the device 2 differs from that of the pic- 

55 ture input to the device 1 . 

The above scrambling method replaces the posi- 
tions of the slices either randomly or in a preselected 
order. Another specific scrambling method will be 
described with reference to FIGS. 17 and 18. Briefly, the 
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alternative method divides each slice into two or more 
strings of macroblocks by a cut point or cut points, and 
then replaces the strings in the same slice in the hori- 
zontal direction or replaces them with the first (left of a 
picture), intermediate or last string of macroblocks of a 5 
different slice, as will be described hereinafter. 

For the simplicity of description, FIG. 17 shows a 
single MPEG2 picture output from the preprocessor 204 
and having eight slices or lines divided by a cut point or 
cut points each. When the picture of FIG. 17 is scram- 10 
bled, a single picture having eight slices or lines shown 
in FIG. 18 is output from the coding device 1 . As shown 
in FIG. 17, the first or top slice has strings A and B of 
macroblocks divided by a single cut point. The second 
slice has strings C, D and E of macroblocks divided by is 
two cut points. Likewise, the third, fourth, fifth, sixth, 
seventh and eight slices respectively have strings of 
macroblocks F, G, H and I, strings of macroblocks J and 
K, strings of macroblocks L and M, strings of macrob- 
locks N, O, P and Q, strings of macroblocks R and S, 20 
and strings of macroblocks T and U. As shown in FIG. 
18, the scrambled picture has the first slice having B 
and A, the second slice having K and J, the third slice 
having Q, P, O and N, the fourth slice having S and R, 
the fifth slice having U and T, the sixth slice having H, F, 25 
G and I, the seventh slice having E, C and D, and the 
eighth slice having M and L 

The data Y, Cb and Cr are sequentially written to 
the frame memories in the order of strings A-U consti- 
tuting the picture shown in FIG. 17 and in the order of 30 
the macroblocks constituting the strings A-U. The data 
Y, Cb and Cr are sequentially read out of the frame 
memories in the order of strings B, A, K, J, Q, P, 0, N, S, 
R, U, T, H, F, G. I, E, C, D, M and L and in the order of 
macroblocks constituting such strings. A signal output 35 
from the coding device 1 and different in order from the 
signal input to the device 1, i.e., a scrambled signal is 
delivered to the monitor 5 via the reproducing device 2. 
However, unless the scrambled signal is descrambled 
by the reproducing device 2, the expected picture does 40 
not appear on the monitor 5 because the position of the 
picture output from the device 2 differs from that of the 
picture input to the device 1 , as stated earlier. 

If desired, the above two scrambling schemes may 
be used in combination and may be applied even to 45 
MPEG1. If the signal input to the recording device 1 is 
not scrambled, then the data Y Cb and Cr may be read 
out of the frame memories in the same order as they 
have been written. Further, desired one of such three 
different scrambling modes may be selected on a so 
scramble mode switch, not shown. 

The multiplexer 222 includes a register having a 
fixed bit length, e.g., eight bits. The variable length 
coded data read out of the memory circuit 222a are writ- 
ten to the register. The register therefore functions to ss 
store eight bits of data. The multiplexer 222 additionally 
functions to confine the amount of codes of each block 
in a preselected range on the basis of a bit distribution 
matching the characteristic of a picture. Specifically, 



when a certain block consisting of DC components and 
AC components, i.e., image data has a total amount of 
data exceeding a preselected amount, the multiplexer 
222 discards the excess data. The multiplexer 222 
packs, under the control of a control signal 354 fed from 
the controller 242, the image data having the prese- 
lected length in the same order as they have been input. 
Subsequently, the multiplexer 222 multiplexes the 
image data in a preselected position of a video bit 
stream structure identical with the MPEG2 structure 
and shown in FIGS. 19A through 21 D. The contents of 
the abbreviations in FIGS. 19A through 21 D are shown 
in FIGS. 22A through 28B. 

Further, the multiplexer 222 multiplexes, under the 
control of the control signal 354, various kinds of 
attribute signals received from the controller 242 via a 
control line 356 in preselected positions shorn in FIGS. 
19A through 21 D. The attribute signals are implemented 
as code values having a fixed length and representative 
of. e.g. ( aspect ratios, picture types and slice start codes 
(including information indicative of the positions of 
slices in the vertical direction), or code values having a 
variable length and representative of, e.g., macroblock 
addresses and macroblock types. In addition, the multi- 
plexer 222 multiplexes, tinder the control of the control 
signal 354, vector values received from the first predic- 
tor 234 and/or the second predictor 236 via a signal line 
350 or 352 in a preselected position. 

Particularly, in the illustrative embodiment, the con- 
trol signals matching the image data and including the 
attribute signals are generated not in the order in which 
the image data are read out of the memory circuit 222a, 
but in the order in which they are written to the memory 
circuit 222a. Therefore, the control signals and the 
image data are not multiplexed in a pair, so that they are 
successfully scrambled. 

In the embodiment, when the operator presses the 
button of the scramble button circuit 244, the control cir- 
cuit 242 sends a synchronizing code representative of 
the start of user data to the multiplexer 222 via the sig- 
nal line 356. The multiplexer 222 multiplexes the syn- 
chronizing code in a position UDSC (User Data Start 
Code) included in a sequence layer. At the same time, 
the multiplexer 222 multiplexes a code representative of 
the execution of scrambling in a preselected position in 
a UD (User Data) area following the UDSC. 

Assume that a picture is scrambled slice by slice. 
Then, when the button of the button circuit 244 is 
pressed, the controller 242 sends codes representative 
of the positions, in the horizontal direction, of each slice 
occurred before and after replacement to the multi- 
plexer 222 via the signal line 356. In response, the mul- 
tiplexer 222 multiplexes such codes in the UD area, in 
this embodiment after the code representative of the 
execution of scrambling. On the other hand, assume 
that each slice is scrambled on a macroblock basis. 
Then, the multiplexer 222 multiplexes, e.g., codes repre- 
sentative of the positions, in the vertical and horizontal 
directions, of the individual string of macroblocks 
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occurred before and after replacement, and codes rep- 
resentative of the number of macroblocks constituting 
the string in the UD area, in this embodiment after the 
code representative of the execution of scrambling. It is 
to be noted that multiplexing positions other than the 5 
UDSC and UD of the sequence layer may be selected 
so long as they are selected beforehand in accordance 
with the system. 

The control data and image data multiplexed by the 
multiplexer 222 in the preselected areas of the frame 
format matching MPEG2 are fed out via the output 112 
included in the multiplexer 222. The signal 1 1 2 is sent to 
the transmitter/receiver 4 via the output terminal DOUT. 
As a result, the signal 112 is digitally broadcast via a 
satellite. 

On the other hand, the dequantizer 226 multiplies 
the normalized data received from the quantizer 218 via 
a signal line 344 by coefficients identical with the quan- 
tizing coefficients, thereby dequantizing the normalized 
data. The dequarttized data appear on an output 364. 
The dequantization is effected under the control of a 
signal fed from the controller via a control line 366. The 
output 364 is connected to the input of the inverse DCT 
circuit 228. 

The inverse DCT circuit 228 transforms the 
dequantized data by bidimensional inverse orthogonal 
transform, combines a plurality of blocks based on the 
inversely transformed data, and thereby produces 
image data representative of a macroblock. The mac- 
roblock of image data appears on an output 368. Such 
transform is effected under the control of a signal fed 
from the control circuit 242 via a control line 370. The 
data output from the inverse DCT circuit 228 are sent to 
the adder 230. 

The adder 230 adds, under the control of a control 
signal 374 fed from the controller 242, the pixel data 
received from the inverse DCT circuit 228 and pixel data 
corresponding to it and received from the fourth switch 
240 via a signal line 332. The resulting sum data 
appears on an output 372. The sum data is fed to the 
corresponding input of the third switch 232. 

The third switch 232 has its input 372 selectively 
connected to one of two outputs 376 and 378 by a con- 
trol signal 374 fed from the controller 242. In the illustra- 
tive embodiment, the input 372 is connected to the 
outputs 376 and 378 alternately. The outputs 376 and 
378 are respectively connected to the input of the first 
predictor 234 and the input of the second predictor 236. 

The predictors 234 and 236 each has memory cir- 
cuit and a motion correcting circuit, although not shown 
specifically. The memory circuits of the predictors 234 
and 236 are implemented as, e.g., DRAMs, and each 
receives one frame of image data for prediction based 
on the future (backward prediction) or on the past (for- 
ward prediction) from the adder 230 via the third switch 
232. 

The motion correcting circuits each receives via a 
signal line 330 a macroblock to be coded, and reads a 
macroblock most resembling the received macroblock 



out of the associated memory circuit. For this purpose, 
the correcting circuit shifts the macroblcok by fifteen pix- 
els in both directions (±15) in the horizontal and vertical 
directions. The most resembling macroblocks appear 
on outputs 384 and 386. Further, the motion correcting 
circuits each includes a computing section for determin- 
ing a motion vector on the basis of the positional relation 
between the received macroblock and the resembling 
macroblock. The motion vectors appear on outputs 350 
and 352. To determine motion vectors, either one of the 
full-scale search and tree search may be used. The pre- 
dictors 234 and 236 perform the above operation under 
the control of control signals fed from the controller 242 
via control inputs 382 and 388. 

The mean circuit 238 receives the data for forward 
prediction from, e.g., the first predictor 234 via its input 
384 and receives the data for backward prediction from 
the second predictor 236 via its input 386. The mean cir- 
cuit 238 computes a mean value (interpolation) of the 
two received data and produces it on its output 390. For 
example, the mean circuit 238 adds the two data and 
then divides the resulting sum by 2. 

The fourth switch 240 has four inputs 384, 386, 390 
and 392 selectively connected to an output 332 by a 
control signal 394 fed from the controller 242. The input 
384 or 386 is selected when a P picture is to be gener- 
ated. The inputs 390 and 392 are respectively selected 
when a B picture is to be generated and when an I pic- 
ture is to be generated. The input 392 is connected to 
ground, i.e., provides a data value "0". The output 332 is 
connected to the corresponding input of the subtracter 
214. 

The scramble button circuit 244 is one of character- 
istic features of the coding device 1 , as stated earlier. 
The button of the button circuit 244 is pressed when, 
e.g. t the operator desires to scramble the moving pic- 
ture output from the camera 3. The button circuit 244 
produces an output 396 which, e.g., goes low (logical 
ZERO) when the button is pressed or goes high (logical 
ONE) when it is not pressed The output 396 is delivered 
to the corresponding input of the controller 242. 

The controller 242 controls and manages the above 
various sections of the coding device 1 and may advan- 
tageously be implemented as a processing system. The 
controller 242 has an input 108 connected to the syn- 
chronizing signal input terminal SYIN of the coding 
device 1 by a signal line 108. The controller 242 gener- 
ates the various control signals based on the synchro- 
nizing signals and delivers them to the various sections 
of the coding device 1, as stated previously. 

When the output of the button circuit 242 is in a high 
level, meaning that the moving picture is not to be 
scrambled, the controller 242 produces on its output 
354 a read control signal identical in the order of 
addresses with a write control signal to be fed to, e.g., 
the memory circuit 222a of the multiplexer, as stated 
previously. 

The controller 242 performs the following operation 
automatically or only when the output of the button cir- 
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cuit 242 goes low so as to indicate that the moving pic- 
ture is to be scrambled. The controller 242 produces on 
the output 354 a read control signal causing the data 
written to the memory circuit 222a from the specific pic- 
ture of FIG. 1 5 in the order of slices to be read out in the 5 
order of addresses corresponding to the order of slices 
of FIG. 16. At the same time, the controller 242 pro- 
duces on the output 356 a synchronizing code indicative 
of the start of user data and codes representative of the 
positions of the slices in the vertical direction occurred w 
before and after scrambling. 

Assume that the moving picture is scrambled on a 
macroblock basis. Then, the controller 242 produces on 
the output 354 a read control signal causing the data 
written to the memory circuit 222a from the specific pic- 15 
ture of FIG. 1 7 in the order of the strings of macroblocks 
to be read out in the order of addresses corresponding 
to the order of strings of macroblocks of FIG. 18. At the 
same time, the controller 242 produces on the output 
356 a synchronizing code indicative of user data, codes 20 
representative of the positions of the strings in the verti- 
cal direction occurred before and after scrambling, and 
codes representative of the numbers of macroblocks 
constituting the strings. The outputs 354 and 356 are 
connected to the corresponding inputs of the multiplexer 25 
222. 

In operation, assume that the video camera 3 feeds 
the NTSC analog luminance signal Y and analog 
chrominance signals Cr and Cb to the coding device 1 
while the button of the button circuit 244 is pressed. 30 
Then, the ADC 202 transforms the luminance signal Y 
and chrominance signals Cr and Cb to digital luminance 
data Y and chrominance data Cr and Cb, and feeds the 
digital data to the preprocessor 204. At this instant, the 
ADC 202 digitizes the luminance signal Y over the 35 
period of one scanning line except for a horizontal 
blanking period with 704 dots, and repeats this over 240 
valid scanning lines (for one field). Also, the ADC 202 
digitizes each of the chrominance signals Cr and Cb 
over the above period with 352 dots, and repeats this 40 
over the same 240 valid scanning lines as the lines of 
the luminance signal Y. The preprocessor 204 sequen- 
tially receives from the ADC 202 signals having the 
above dot and scanning line configuration. The preproc- 
essor 204 produces, based on the first and second field 45 
of data sequentially input, data constituted by MPEG2 
parameters adaptive to NTSC. The resulting MPEG2 
data are sequentially delivered to the first frame mem- 
ory 206 frame by frame (picture by picture). FIG. 13A 
demonstrates how such data are input to the memory so 
206 frame by frame. In FIG. 1 3A, picture types based on 
the coding system to be executed are shown in the con- 
secutive pictures. 

Assume that data 60, B1, 12 and B3 included in a 
GOP1 shown in FIG. 1 3 A are sequentially written to the 55 
first, second, third and fourth frame memories of the 
memory 206, respectively. Also, assume that the data 
B0 and B1 read out of the first and second frame mem- 
ories of the memory 206, respectively, are respectively 
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written to the first and second frame memories of the 
second frame memory 21 0 via the first switch 208. 

First, the controller 242 causes the data 12 of the 
GOP1 , which is to be coded first, to be read out of the 
third frame memory of the first frame memory 206 on a 
macroblock basis. The data 12 is applied to one input 
330 of the subtracter 214 via the second switch 212. 
The controller 242 causes the data value "0" to be fed to 
the other input 332 of the subtracter 214. The subtracter 
214 performs subtraction with the two input data values 
and sends the resulting difference to the DCT circuit 
216. The image data represented by the above differ- 
ence is subjected to intra-frame coding by the DCT cir- 
cuit 216 and circuitry following it, as will be described 
hereinafter. 

The DCT circuit 216 receives the data from the sub- 
tracter 214 on a macroblock basis, divides each mac- 
roblock of data into a plurality of blocks of data, 
performs bidimensional orthogonal transform with the 
individual block of data, and sends the transformed data 
to the quantizer 218. The quantizer 218 normalizes the 
transformed data, i.e., transform coefficients and then 
delivers them to the variable length coder 220 and 
dequantizer 226. The coder 220 transforms the normal- 
ized transform coefficients to Huffman codes and feeds 
the Huffman codes to the multiplexer 222. The multi- 
plexer 222 scrambles the data undergone variable 
length Huffman coding, provides the data with a fixed 
length, regulates the block-by-block data to a predeter- 
mined amount of code, and multiplexes the resulting 
data at preselected positions shown in FIGS. 19A-21D. 
In addition, the multiplexer 222 multiplexes the various 
kinds of attribute signals and information relating to 
scrambling received from the controller 242 at prese- 
lected positions shown in FIGS. 19A-21D. In this case, 
the multiplexed control signals and the image data are 
not in a pair due to scrambling. The multiplexed data, 
i.e., a signal having a frame format conforming to 
MPEG2 is fed to the transmitter/receiver 4 via the output 
DOUT of the coding device 1 , digitally broadcast via a 
satellite, and then received. Specifically, the data 12 of 
the GOP1 shown in FIG. 13B is fed from the device 1 to 
the transmitter/receiver 4, so that the transmit- 
ter/receiver 4 digitally broadcasts the data 12 of the 
GOP1 shown in FIG. 13C. 

On the other hand, the dequantizer 226 multiplies 
the normalized transform coefficients received from the 
quantizer 218 by the quantizing coefficients, thereby 
producing dequantized data. The dequantized data are 
fed to the inverse DCT circuit 228. The inverse DCT cir- 
cuit 228 performs bidimensional inverse orthogonal 
transform with the dequantized data, combines a plural- 
ity of blocks to produce a macroblock of data, and deliv- 
ers the image data to the adder 230 on a macroblock 
basis. The adder 230 adds each inversely transformed 
data value and the data value "0" fed via the fourth 
switch 240, and delivers the sum data to the first predic- 
tor 234 via the third switch 232. The predictor 234 stores 
the sum data sequentially received from the adder 230, 
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i.e., one frame of data 12. At this time, the second pre- 
dictor 236 has already stored data P8 of a GOPO pre- 
ceding the GOP1. 

On processing alt the data 12 of the GOP1 , the con- 
troller 242 reads the data BO to be coded next out of the s 
first frame memory of the memory 21 0 on a macroblock 
basis, and causes the data 60 to be input to one input 
330 of the subtracter 214 via the second switch 212. At 
the same time, the controller 242 causes data output 
from the mean circuit 238 to be input to the other input 10 
332 via the fourth switch 240. The subtracter 214 per- 
forms subtraction with the two input data values and 
delivers the resulting difference to the DCT circuit 216. 
In this case: the mean circuit 238 delivers to the adder 
2 1 4 data representative of the mean of the data 12 of the is 
GOP1 and the data P8 of the GOPO having been stored 
in the predictors 234 and 236, respectively. Stated 
another way, the subtracter 21 4 executes interpolatory 
interframe prediction coding in order to generate a B 
picture. When. use is made of the data undergone 20 
motion correction for the subtraction, the predictor 234 
and/or the predictor 236 feeds data representative of 
motion vectors to the multiplexer 222. The multiplexer 
222 multiplexes the motion vectors in the previously 
stated manner. 25 

The circuitry extending from the DCT circuit 216 to 
the multiplexer 222 processes the data output from the 
subtracter 214, as stated earlier. As a result, the data 
BO of the GOP1 is fed from the coding device 1 to the 
transmitter/receiver 4, digitally broadcast from the trans- 30 
mitter/receiver 4, and then received. At this instant, the 
circuitry extending from the first predictor 234 to the 
adder 230 does not have to operate. Therefore, the data 
12 of the GOP1 and the data P8 of the GOPO are still left 
in the two predictors 234 and 236, respectively. 35 

On fully processing the data BO of the GOP1, the 
controller 242 reads the data B1 to be coded next out of 
the second frame memory of the memory 210. The data 
B1 is fed to one input 330 of the subtracter 214 via the 
second switch 212. At the same time the controller 242 40 
causes the data output from the mean circuit 238 to be 
fed to the other input 332 of the subtracter 214. The 
subtracter 214 performs subtraction with the two input 
data values. Difference data output from the subtracter 
214 is processed by the circuitry extending from the 45 
DCT circuit 216 to the multiplexer 222 in the previously 
stated manner. Consequently, the data B1 of the GOP1 
is delivered from the coding device 1 to the transmit- 
ter/receiver 4, digitally broadcast from the transmit- 
ter/receiver 4, and then received. so 

Subsequently, the controller 242 writes data B4, 
P5, B6, B7 and P8 of the GOP1 in the fifth, sixth, sev- 
enth, eighth and ninth frame memories of the first frame 
memory 206, respectively. Further, the controller 242 
writes the data B3 and B4 read out of the fourth and fifth ss 
frame memories of the memory 206, respectively, in the 
first and second frame memories of the secone frame 
memory 210 via the first switch 208. 

First, the controller 242 reads the data P5 of the 
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GOP1 to be coded next out of the sixth frame memory 
of the memory 206 on a macroblock basis. The data P5 
is fed to one input 330 of the subtracter 21 4 via the sec- 
ond switch 212. At the same time, the controller 242 
causes the data output from the first predictor 234 to be 
fed to the other input 332 of the subtracter 214 via the 
second switch 212. In this case, the predictor 234 stores 
the data 12 of the GOP1. The subtracter 214 performs 
subtraction with the two input data values and feeds 
image data representative of the resulting difference to 
the DCT circuit 216. Stated another way, the subtracter 
214 executes forward interframe prediction coding for 
producing a P picture. When use is made of the data 
undergone motion correction for the subtraction, the 
predictor 234 feeds data representative of motion vec- 
tors to the multiplexer 222. 

The data output from the subtracter 214 is proc- 
essed by the circuitry extending from the DCT circuit 
216 to the multiplexer 222 in the previously described 
manner. The data P5 of the GOP1 is fed from the coding 
device 1 to the transmitter/receiver 4, digitally broadcast 
via a satellite, and then received. The data output from 
the quantizer 218 is processed by the circuitry extend- 
ing from the dequantizer 226 to the DCT circuit 228 in 
the previously stated manner and then applied to the 
adder 230. The adder 230 adds the data value received 
from the inverse DCT circuit 228 and the data value 
received from the first predictor 228 via the fourth switch 
240, and delivers the sum data to the second predictor 
336 via the third switch 232. As a result, the data P5 of 
the GOP1 is written to the predictor 236, At this instant, 
the data 12 of the GOP1 is still left in the predictor 234. 
The coding device 1 repeats the above coding proce- 
dure with the subsequent data B3, B4, P8, B6 and B7. 
The resulting coded data are also fed from the device 1 
to the transmitter/receiver 4 one after another. So long 
as the scramble mode is not cancelled, data of a GOP2 
and successive GOPs will also be sequentially coded in 
the same manner as the data of the GOIP1 . 

As stated above, when the controller 242 receives a 
signal indicative of the scramble mode from the button 
circuit 244, it reads image data not paired with the con- 
trol data out of the memory circuit 222a. At the same 
time, the controller 242 outputs information relating to 
scrambling, i.e., information representative of the 
scramble mode and information representative of the 
positions of the individual slice occurred before and 
after replacement. Alternatively, the controller 242 may 
output information representative of the scramble mode, 
information representative of the positions of the individ- 
ual string of macroblocks occurred before and after 
replacement, and information representative of the 
number of macroblocks constituting the individual 
string, as described previously. 

Referring to FIGS. 5 and 6, the expansion repro- 
ducing device 2 also embodying the present invention 
will be described. The reproducing device 2 descram- 
bles and decodes the image data scrambled and 
decoded by the coding device 1 described with refer- 



11 



EP0008055 39 [file://S:\PATENT FILESWixs Sys tems (1459 J GDWI XS Patents\ViXS010C\References\EP00Q80559 9.cpc1 



Page 12 of 6i 



21 



EP0 805 599 A2 



22 



ence to FIGS. 1 and 2. As shown, the reproducing 
device 2 is made up of a demultiplexer 402, a decoder 
404, a dequantizer 406, an inverse DCT circuit 408, an 
adder 410, a first switch 41 2, a first predictor 414, a sec- 
ond predictor 416, a mean circuit 418, a second switch 
420, a third switch 422, a postprocessor 424, a digital- 
to-analog converter (DAC), a controller 428, and a 
descramble button circuit 430. 

As shown in FIG. 5, the demultiplexer 402 has an 
input 114 connected to the input terminal DIN of the 
reproducing device 2. The signal having the frame for- 
mat conforming to MPEG2 is fed from the coding device 
1 or the transmitter/receiver 4 to the demultiplexer 402. 
In response, the demultiplexer 402 demultiplexes the 
multiplexed signal to separate the image data and con- 
trol data. The separated image data and control data 
appear on outputs 504 and 506, respectively. This is 
controlled by a control signal fed from the controller 428 
via a control line 508. The outputs 504 and 506 are 
respectively connected to the input of the decoder 404 
and the input of the controller 428. The controller 428 
controls the entire device 2 in accordance with the con- 
trol data 506. 

The decoder 404 includes a memory circuit 404a 
for descrambling the scrambled image data received 
from the multiplexer 402. In the illustrative embodiment, 
the memory circuit 404a is implemented as a DRAM 
having a capacity great enough to store two frames of 
data Y Cb and Cr. The capacity of the memory circuit 
404a may be great enough to store three or more 
frames, if desired. A frame memory for storing the data 
Y, Cb and Cr is constituted by a first and a second frame 
memory. The coded data Y, Cb and Cr sequentially fed 
from the demultiplexer 402 in this order are sequentially 
repeatedly written to the first and second frame memo- 
ries in this order. In this embodiment, while the data are 
written to the first frame memory, the data are read out 
of the second frame memory; while the data are written 
to the second frame memory, the data are read out of 
the first frame memory. The writing and reading of data 
out of such frame memories are controlled by a control 
signal fed from the controller 428 via a control line 512. 

Specifically, assume that image data are sequen- 
tially fed from the coding device 1 to the reproducing 
device 2 via the transmitter/receiver 4 in the order of 
slices constituting one scrambled picture shown in FIG. 
16. Then, the data Y Cb and Cr demultiplexed by the 
demultiplexer 402 are sequentially written to the above 
memories in the order of slices constituting the picture 
shown in FIG. 16, i.e., C, B, D, A, E, H, G and F and in 
the order of macroblocks constituting the slices. The 
data so written to the memories are sequentially read 
out of the memories in the order of slices constituting 
the picture shown in FIG. 15, i.e., A, B, C, D, E, F, G and 
H and in the order of macroblocks constituting the 
slices. In this manner, the signal is descrambled by 
being read out in the order of slices different from the 
order of writing. As a result, the image data sequentially 
read out and the control signals sequentially input are 



paired again. 

Assume that image data are sequentially fed from 
the coding device 1 to the reproducing device 2 in the 
order of strings of macroblocks constituting one scram- 

5 bled picture shown in FIG. 18. Then, the data Y, Cb and 
Cr demultiplexed by the demultiplexer 402 are sequen- 
tially written to the memories in the order of strings con- 
stituting the picture shown in FIG. 18, i.e., B, A, K, J, Q, 
P, O, N, S. R, U. T, H, F, G, I, E, C, D, M and L and the 

10 order of macroblocks constituting the strings. The data 
so written to the memories are sequentially read out of 
the memories in the order of strings constituting the pic- 
ture shown in FIG. 17, i.e.. A, B, C, D, E, F, G, H, I, J, K, 
L, M, N, O, P, Q, R, S, T and U and in the order of mac- 

15 roblocks constituting the strings. In this manner, the sig- 
nal is descrambled by being read out in the order of 
strings different from the order of writing. As a result, the 
image data sequentially read out and the control signals 
sequentially input are paired again. 

20 The decoder 404 decodes, under the control of a 
control signal fed from the controller 428 via a control 
line 512, the descrambled coded data fed from the 
memory circuit 404a by Huffman decoding. The 
decoded data appear on an output 510 connected to the 

25 input of the dequantizer 406. 

The dequantizer 406 multiplies the decoded data 
(normalized data) fed from the decoder 404 via the sig- 
nal line 501 by the quantizing coefficients received via a 
control input 516, thereby producing dequantized data. 

30 The dequantized data are delivered to the inverse DCT 
circuit 408 via an output 514. The dequantization is exe- 
cuted under the control of a signal fed from the control- 
ler 428 via the control line 516. 

The inverse DCT circuit 408 performs, under the 

35 control of a control signal fed from the controller 428 via 
a control line 520, bidimensional orthogonal transform 
with the input dequantized data and produces the 
resulting data on its output 518. The data output from 
the DCT circuit 408 are fed to the adder 410. 

40 Assume that the data input to the adder 410 are 
representative of an I picture, i.e., the data have been 
subjected to intra-frame coding. Then, in the illustrative 
embodiment, the adder 410 adds to the input data value 
518 data value "O" fed from the second switch 420 

45 which will be described. The resulting sum data appear 
on an output 524. In this case, the pixel data 518 
appearing on the input 518 are directly fed out. If 
desired, the input data 518 may be directly applied to 
the output 524 without the addition of "0". Assume that 

so data representative of a P picture, i.e., undergone inter- 
frame forward coding are input to the adder 410. Then, 
in the embodiment, the adder 41 0 adds to the input data 
value 518 the data value 522 of an I or a P picture 
received from the first or the second predictor 414 or 

55 416 via the second switch 420. The resulting sum data 
also appear on the output 524. Further, assume that 
data representative of a B picture, i.e., undergone bidi- 
rectional prediction coding are input to the adder 410. 
Then, the adder 410 adds to the input data value 519 
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mean (interpolation) data 522 received from the mean 
circuit 418 via the switch 420. The resulting sum data 
also appear on the output 424. Such addition is effected 
under the control of a control signal 526 fed from the 
controller 428. The output 524 of the adder 410 is con- 
nected to the corresponding inputs of the first and third 
switches 412 and 422. 

The first switch 412 selectively delivers, under the 
control of a control signal 525 received from the control- 
ler 428, the I picture data or the P picture data applied to 
its input 524 to its output 528 or 534. In the illustrative 
embodiment, the outputs 528 and 534 are selected 
alternately. The outputs 528 and 534 are connected to 
the inputs of the first and second predictors 414 and 
416, respectively. 

The first predictor 414 includes a memory circuit 
implemented by a DRAM by way of example. One frame 
of data representative of one of the I and P pictures are 
written to the memory circuit. The predictor 414 reads 
out of its memory circuit the image data on the basis of 
the vector values input via its input 532, and produces 
them on its output 530 as a predicted block. The pre- 
dicted block data are delivered to the adder 410 via the 
mean circuit 418 and second switch 420. Further, the 
predictor 414 reads the image data out of the memory 
circuit and delivers them to the third switch 422 via the 
output 530 as a final reproduced image block. Such a 
procedure is controlled by a control signal fed from the 
controller 428 via the control line 532. The output 530 of 
the predictor 414 is connected to the corresponding 
inputs of the mean circuit 418 and switches 420 and 
422. 

The second predictor 416 is basically identical in 
configuration with the first predictor 414 and will not be 
described specifically in order to avoid redundancy. The 
predictor 416 has its output 536 connected to the corre- 
sponding inputs of the mean circuit 418 and switches 
420 and 422, and has its control input 538 connected to 
the corresponding output of the controller 428. 

The mean circuit 418 produces a mean (interpola- 
tion) of the data received from the two predictors 414 
and 416 and corresponding to each other. The resulting 
mean data appears on an output 540. The operation of 
the mean circuit 418 is controlled by a control signal 
received from the controller 428 via a control line 543. 

The second switch 420 selectively connects, under 
the control of a control signal 544 fed from the controller 
428, one of its four inputs 530, 536, 540 and 542 to its 
output 522. Basically, the input 530 or 536 is selected to 
generate a P picture while the input 540 is selected to 
generate a B picture. Further, the input 542 is selected 
to generate an I picture. The output 522 is connected to 
the corresponding input of the adder 410. 

The third switch 422 selectively connects, under the 
control of a control signal 548 fed from the controller 
428, one of its three inputs 524, 530 and 536 to its out- 
put 546. Basically, the input 530 or 536 is selected to 
deliver the reproduced data representative of an I pic- 
ture of a P picture to the postprocessor 424 which will 



be described. The input 524 is selected to deliver the 
reproduced data representative of a B picture to the 
postprocessor 424. The output 546 is connected to the 
corresponding input of the postprocessor 424. 

5 As shown in FIG. 6, the postprocessor 424 includes 
a nine-frame memory 424a and a signal processing cir- 
cuit 424b. In this embodiment, the memory 424a has a 
capacity great enough to accommodate nine frames of 
reproduced data. The memory 424a sequentially stores 

w the reproduced data received via the input 546. In this 
case, the reproduced data constitute the MPEG2 frame 
format. The frame memory 424a is made up of a first to 
a ninth frame memory. The signal processing circuit 
424b receives the signal of MPEG2 frame format stored 

is in the memory 424a, and produces from the received 
signal data of the same formats as the data fed to the 
inputs 302, 304 and 306 of the preprocessor 204. As a 
result, the data Y of the same format as the data fed to 
the input 302, the data Cr of the same format as the 

20 data fed to the input 304, and the data Cb fed to the 
input 306 appear on outputs 552, 554 and 556, respec- 
tively. Such postprocessing is controlled by a control 
■ signal fed from the controller 428 via a control line 558. 
If desired, an arrangement may be made such that the 

25 data output from the adder 410 and the data output from 
the two predictors 414 and 416 are directly applied to 
the signal processing circuit 424b without the intermedi- 
ary of the frame memory 424a. 

The DAC 426 receives the data Y, Cr and Cb via its 

30 inputs 552, 554 and 556 and transforms them to image 
signals represented by corresponding analog values. 
Further, the DAC 426 generates an NTSC video signal 
based on the transformed signals. The NTSC video sig- 
nal appear on an output 116. The controller 428 feeds 

35 control signals necessary for such DA conversion and 
including sampling pulses to the DAC 426 via a control 
line 562. 

The reproducing circuit 2 includes the previously 
mentioned descramble button circuit or switch 430. The 

40 operator may press the button included in this circuit 
430 in order to descramble the scrambled coded data 
received from the coding device 1. The circuit 430 has 
an output 564 which goes, e.g., low when the button is 
pressed or remains in a high level when it is not 

45 pressed. 

The controller 428 controls and manages the above 
various sections of the reproducing device 2 and may 
advantageously be implemented as a processing sys- 
tem. The controller 428 receives various signals includ- 

so ing a signal representative of a macroblock type 
(MBTYPE) via the control input 506, generates various 
control signals based on the received signals, and deliv- 
ers each of the control signals to a particular section. 
Particularly, in the illustrative embodiment, the con- 

55 troller 428 performs the following operation automati- 
cally or only when the output of the button circuit 430 is 
in a low level indicating a descramble mode. The con- 
troller 428 monitors trie UD of the sequence layer 
sequentially arriving thereat in order to see if it includes 
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the code showing that scrambling has been effected. 
The controller 428 determines, rf such a code is absent, 
that the GOP has not been scrambled or determines, if 
the code is present, that the GOP has been scrambled. 
When the output of the button circuit 430 is in a high 
level showing that descrambling is not necessary, the 
controller 428 does not have to monitor the UD of the 
sequence layer. Therefore, even if the reproducing 
device 2 receives scrambled coded data from the cod- 
ing device 1, it does not descramble the received data. 
The button circuit 430 is omissible if the controller 428 is 
constructed to constantly monitor the UD of the 
sequence layer. 

In the illustrative embodiment, when the code rep- 
resentative of the execution of scrambling is absent, the 
controller 428 outputs a read control signal in the order 
of addresses in which the data are written to the mem- 
ory circuit 404a of the decoder 404. If the above code is 
present, the controller 428 reads the various multi- 
plexed information following the code. The multiplexed 
information show the positions of the slices or those of 
the strings of macroblocks occurred before and after 
replacement, and the number of macroblocks constitut- 
ing each slice or each string of macroblocks. The con- 
troller 428 generate control signals based on such 
information and feeds them to the memory circuit 404a. 
More specifically, in this condition, the data identical in 
number with the macroblocks have been written to the 
memory circuit 404a in the order of addresses before 
replacement. The controller 428 therefore should only 
output a control signal for reading the same number of 
data as the number of macroblocks in the order of 
addresses before replacement. 

When the data are scrambled slice by slice, each 
slice, of course, consists of a preselected number of 
macroblocks, e.g., thirty-three in the case of MPEG1 or 
forthy-four in the case of MPEG2. In this case, the con- 
troller 428 should only count a number selected before- 
hand and does not have to read the information 
representative of the number of macroblocks. In addi- 
tion, the coding device 1 does not have to multiplex such 
information, It is to be noted that even if the code repre- 
sentative of the execution of scrambling is absent, the 
controller 428 may generate the read control signal for 
descrambling so long as the information representative 
of the positions of the slices or those of the macroblocks 
occurred before and after replacement and the informa- 
tion representative of the number of macroblocks con- 
stituting the individual string of macroblocks are 
available. 

With the reproducing device 2 shown and 
described, it is possible to expand and reproduce the 
image data compressed and scrambled by the coding 
device 1 shown in FIGS. 1 and 2. The operation of the 
reproducing device 2 will be described hereinafter. 

Assume that the data are input to the reproducing 
device 2 from the transmitter/receiver 4 in the specific 
order shown in FIG. 13C. Then, the data 12 of the GOP1 
are input to the device 2 after a sequence header. Also, 



assume that a signal indicative of the descramble mode 
is fed from the button circuit 430 of the device 2 to the 
controller 428. Then, the multiplexer 402 demultiplexes 
the signal received from the transmitter/receiver 4 into 

5 image data and control data. The image data and con- 
trol data are applied to the decoder 404 and controller 
428, respectively. The controller 428 controls the vari- 
ous sections of the device 2 in accordance with the con- 
trol data. Also, the controller 428, monitoring the UD or 

10 control data included in the sequence layer, determines 
whether or not information representative of the scram- 
ble mode is present. Because such information is 
present in this case, the controller 428 sees that the 
GOP1 has been scrambled. Subsequently, the control- 

15 ler 428 determines whether or not the above information 
is followed by information representative of the positions 
of slices or those of the strings of macroblocks occurred 
before and after replacement or scrambling, and infor- 
mation representative of the number of macroblocks 

20 constituting the individual slice or the individual string of 
macroblocks. Because these information are also 
present in this case, the controller 428 decodes the 
information, generates a read control signal based on 
the decoded information, and feeds the control signal 

25 via its output 512. 

On the other hand, the scrambled coded data 12 of 
the GOP1 and fed from the demultiplexer 402 are writ- 
ten to the memory circuit 404a of the decoder 404. The 
data 12 are read out of the memory circuit 404a by the 

30 read control signal output from the controller 428 and 
descrambled thereby. The decoder 404 decodes the 
data 12 read out by Huffman decoding on a coded data 
basis. The decoded data are fed from the decoder 404 
to the dequantizer 406. The dequantizer 406 multiplies 

35 the decoded data by the quantizing coefficients and 
delivers the resulting dequantized data to the inverse 
DCT circuit 408. The inverse DCT circuit 408 executes 
bidimensional orthogonal transform with the input data 
and delivers the inversely transformed data to the adder 

40 410. The adder 410 adds the input data values and the 
data value "0" received from the second switch 420. In 
this case, the sum data output from the adder 410 is fed 
to the first predictor 414. As a result, the data 12 of the 
GOP1 are written to the first predictor 414. At this 

45 instant, the second predictor 41 6 has already stored the 
data P8ofthe GOP0. 

After the data 12 of the GOP1 have been proc- 
essed, the scrambled coded data B0 of GOP1 sepa- 
rated by the demultiplexer 402 are written to the 

so memory circuit 404a of the decoder 404. The data B0 
are read out of the memory circuit 404a by a read con- 
trol signal generated the controller 428. As a result, the 
data B0 are descrambled in the same manner as the 
data 12. The decoder 404 decodes the data B0 read out 

55 by Huffman decoding on a coded data basis. The 
decoded data are fed from the decoder 404 to the 
dequantizer 406. The circuitry extending from the 
dequantizer 406 to the inverse DCT circuit 408 proc- 
esses the data B0 in the previously described manner, 
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so that inversely transformed data are fed to the adder 
410. The adder 410 adds the data value output from the 
inverse DOT circuit 408 and the data value received 
from the mean circuit 418 via the second switch 420. 
The resulting sum data is delivered to the postprocessor 
424 via the third switch 422. Consequently, the data B0 
are written to the first frame memory of the postproces- 
sor 424. Because the data B0 are representative of a B 
picture, they are not written to either the first predictor 
414 or the second predictor 416. The data B0 are read 
out of the first frame memory and fed to the DAC 426. 
Subsequently, an NTSC video signal is generated on 
the basis of the data B0 and applied to the monitor 5, so 
that a picture based on the data B0 appears on the 
monitor 5. 

After the data BO of the GOP1 have been proc- 
essed, the scrambled coded data B1 of the GOP1 sep- 
arated by the demultiplexer 402 are written to the 
memory circuit 404a of the decoder 404. The data BO 
are read out of the memory circuit 404a by a read con- 
trol signal generated by the controller 428. As a result, 
the data B1 are descrambled in the same manner as the 
data 12. The decoder 404 decodes the data B1 read out 
by Huffman decoding on a coded data basis. The 
decoded data are fed from the decoder 404 to the 
dequarttizer 406. Because the data B1 are also repre- 
sentative of a B picture, they are also processed by the 
circuitry processed by data BO. As a result, the data B1 
are written to the second frame memory of the post- 
processor 424. The data B1 representative of a B pic- 
ture are not written either to the predictor 414 or to the 
predictor 416. The data B1 are read out of the second 
frame memory and fed to the DAC 426. Subsequently, 
an NTSC video signal is generated on the basis of the 
data B1 and applied to the monitor 5, so that a picture 
based on the data B1 appears on the monitor 5. 

Subsequently, the data 12 of the GOP1 stored in the 
first predictor 414 are read out and written to the third 
frame memory of the postprocessor 424. The data 12 
are read out of the third frame memory and fed to the 
DAC 426. An NTSC video signal based on the data 12 is 
applied to the monitor 5 with the result that a picture 
based on the data 12 appears on the monitor 5. 

Next, the scrambled coded data P5 of the GOP1 
separated by the demultiplexer 402 are written to the 
memory circuit 404a of the decoder 404. The data P5 
are read out of the memory circuit 404a by a read con- 
trol signal generated the controller 428, and are 
descrambled thereby. The decoder 404 decodes the 
data P5 read out by Huffman decoding on a coded data 
basis. The decoded data are fed from the decoder 404 
to the dequantizer 406. The circuitry extending from the 
dequantizer 406 to the inverse DCT circuit 408 proc- 
esses the data P5 in the previously described manner, 
so that inversely transformed data are fed to the adder 
410. The adder 410 adds the data value output from the 
inverse DCT circuit 408 and the data value received 
from the first predictor 414 via the second switch 420. 
The resulting sum data is delivered to and stored in the 



second predictor 416. At this instant, the data 12 are still 
left in the first predictor 414. The subsequent data B3, 
B4, P8, B6 and B7 are also sequentially decoded by the 
above procedure. The decoded data are sequentially 

5 fed to the postprocessor 424 in the order of B3, B4, P5, 
B6, B7 and P8. These data are sequentially written to 
the fourth to ninth frame memories of the postprocessor 
424. The data B3-P8 are sequentially read out of the 
fourth to ninth frame memories and applied to the DAC 

10 426. NTSC video signals based on the data B3-P8 are 
sequentially generated and applied to the monitor 5. As 
a result, pictures based on the data B3-P8 sequentially 
appear on the monitor 5 in the form of a moving picture. 
Again, the controller 428, monitoring the UD or con- 

15 trot data included in the following sequence layer, deter- 
mines whether or not information representative of the 
scramble mode is present. If such information is 
present, the controller 428 sees that the GOP2 has also 
been scrambled. Subsequently, the controller 428 

20 determines whether or not the above information is fol- 
lowed by information representative of the positions of 
slices or those of the strings of macroblocks occurred 
before and after replacement or scrambling, and infor- 
mation representative of the number of macroblocks 

25 constituting the individual slice or the individual string of 
macroblocks. If these information are present, the con- 
troller 428 decodes the information, generates a read 
control signal based on the decoded information, and 
feeds the control signal via its output 512. In this case, 

30 the device 2 performs sequential descrambling and 
decoding with the GOP2 in the same manner as with 
the GOP1, and delivers the reproduced data to the 
monitor 5 in the order of B0, B1, 12, B3, B4 ( P5, B6, B7 
and P8. Consequently, the monitor 5 sequentially dis- 
ss plays pictures based on the above data B0-P8 in the 
form of a moving picture. 

If none of the information relating to scrambling is 
present in the UD of the sequence layer, the device 2 
does not have to descrarnble received data. Therefore, 

40 even if the descrarnble button of the button circuit 430 is 
pressed, the controller 428 should only output a read 
signal identical with the read control signal meant for the 
memory circuit 404a. This allows the moving picture to 
appear on the monitor 5 faithfully. 

45 In summary, it will be seen that the present inven- 
tion provides a compression coding device capable of 
outputting scrambled signals effectively simply by 
replacing slices or strings of macroblocks constituting a 
frame or picture. Also, the present invention provides an 

so expansion reproducing device capable of descrambling 
the scrambled signals effectively to thereby output 
descrambled image data. 

While the present invention has been described 
with reference to the particular illustrative embodiments, 

55 K is not to be restricted by those embodiments. It is to be 
appreciated that those skilled in the art can change or 
modify the embodiments without departing from the 
scope and spirit of the present invention. 
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Claims 3. 

1 . A compression, coding device for handling a single 
picture or a preselected plurality of pictures as a 
single group of pictures, and coding digital image s 
data representative of an individual picture included 

in the single group of pictures, and having a scram- 
bling function, said device comprising: 

coding means (216,218,220) for coding the 10 
image data representative of the individual pic- 
ture to thereby output coded image data; 
storing means (222a) for storing the coded 4. 
image data output from said coding means 
(216,218,220); is 
multiplexing means (222) for multiplexing the 
coded image data read out of said storing 
means in a preselected position of an output 
data format; and 

control means (242) for controlling said coding 20 
means (216, 218,220), said storing means 5. 
(222a) and said multiplexing means (222) on 
the basis of a preselected scrambling system; 

wherein the image data representative 
of the individual picture are divided into a plu- 2s 
rality of slices each being subdivided into a plu- 
rality of macroblocks; and 

wherein said control means (242) gen- 
erates, when writing the coded image data in 6. 
said storing means (222a), a control signal for 30 
writing the coded image data in an order of 
positions of the slices, from top to bottom as 
seen on a picture, constituting the individual 
picture, and feeds said control signal to said 
storing means (222a), generates, when scram- 35 
bling the coded image data on the basis of said 
preselected scrambling system, a control sig- 7. 
nal for reading the coded image data in an 
order of the slices different from said order of 
writing to thereby output scrambled coded 40 
image data, feeds said control signal to said 
storing means (222a) to thereby cause said 
multiplexing means (222) to multiplex the 
scrambled coded image data fed thereto in the 
preselected position of the output data format, 45 
generates information representative of posi- 
tions of the slices occurred before and after the 
scrambling, and feeds said information to said 
multiplexing means (222) as control data to 
thereby cause said multiplexing means (222) to so 
multiplex said control data in a preselected 
position of the output data format. 

2. A device as claimed in claim 1, further comprising 
scramble button circuit means (244) for outputting a ss 
scramble command signal, wherein said control 
means (242) outputs said control signal for reading 
only when said scramble command signal is input 

to said control means (242). 



A device as claimed in claim 1 , wherein said storing 
means (222a) comprises first and second memory 
means each for storing the coded image data rep- 
resentative of two pictures, and wherein said con- 
trol means (242) causes, while the coded image 
data are written to said first memory means, the 
coded image data to be read out of said second 
memory means or causes, while the coded image 
data are written to said second memory means, the 
coded image data to be read out of said first mem- 
ory means. 

A device as claimed in claim 1 , wherein said control 
means (242) further generates information showing 
that the scrambling has been executed, and feeds 
said information to said multiplexing means (222) 
as control data to thereby cause said multiplexing 
means (222) to multiplex said information in a 
preselected position of the output data format. 

A device as claimed in claim 2, wherein said control 
means (242) further generates information showing 
that the scrambling has been executed, and feeds 
said information to said multiplexing means (222) 
as control data to thereby cause said multiplexing 
means to multiplex said information in a prese- 
lected position of the output data format. 

A device as claimed in claim 3, wherein said control 
means (242) further generates information showing 
that the scrambling has been executed, and feeds 
said information to said multiplexing means (222) 
as control data to thereby cause said multiplexing 
means to multiplex said information in a prese- 
lected position of the output data format. 

A compression coding device for handling a single 
picture or a preselected plurality of pictures as a 
single group of pictures, and coding digital image 
data representative of an individual picture included 
in the single group of pictures, and having a scram- 
bling function, said device comprising: 

coding means (216,218,220) for coding the 
image data representative of the individual pic- 
ture to thereby output coded image data; 
storing means (222a) for storing the coded 
image data output from said coding means 
(216,218,220); 

multiplexing means (222) for multiplexing the 
coded image data read out of said, storing 
means (222a) in a preselected position of an 
output data format; and 

control means (242) for controlling said coding 
means (216, 218,220), said storing means 
(222a) and said multiplexing means (222) on 
the basis of a preselected scrambling system; 

wherein the image data representative 
of the individual picture are divided into a plu- 
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rality of slices each being subdivided into a plu- 
rality of macroblocks; and 

wherein said control means (242) gen- 
erates, when writing the coded image data in 
said storing means (222a). a control signal for 5 
writing the coded image data in an order of 
positions of the slices as seen on the picture, 
and feeds said control signal to said storing 
means, and generates, when scrambling the 
coded image data on the basis of said prese- 10 
lected scrambling system, a control signal for 
reading the coded image data out of said stor- 
ing means (222a) at positions of the slices 
identical with or different from the positions for 
writing and by varying positions of strings of the 75 
macroblocks divided by cut points to thereby 
output scrambled coded image data, feeds said 
control signal to said multiplexing means (222) 
to thereby cause said multiplexing means (222) 
to multiplex the scrambled coded image data in 20 
a preselected position of the output data for- 
mat, outputs information representative of the 
positions of the strings of the macroblocks 
occurred before and after the scrambling and a 
number of macroblocks constituting an individ- 2 s 
ual string of macroblocks, and feeds said infor- 
mation to said multiplexing means (222) as 
control data to thereby cause said multiplexing 
means (222) to multiplex said information in a 
preselected position of the output data format. 30 

8. A device as claimed in claim 7, further comprising 
scramble button circuit means (244) for outputting a 
scramble command signal, wherein said control 
means (242) outputs said control signal for reading 35 
only when said scramble command signal is input 

to said control means (242). 

9. A device as claimed in claim 7, wherein said storing 
means (222a) comprises first and second memory 40 
means each for storing the coded image data rep- 
resentative of two pictures, and wherein said con- 
trol means (242) causes, while the coded image 
data are written to said first memory means, the 
coded image data to be read out of said second 45 
memory means or causes, while the coded image 
data are written to said second memory means, the 
coded image data to be read out of said first mem- 
ory means. 

so 

10. A device as claimed in claim 7, wherein said control 
means (242) further generates information showing 
that scrambling has been executed, and feeds said 
information to said multiplexing means (222) as 
control data to thereby cause sard multiplexing 55 
means (222) to multiplex said information in a 
preselected position of the output data format. 

1 1 . A device as claimed in claim 8, wherein said control 



means (242) further generates information showing 
that scrambling has been executed and feeds said 
information to said multiplexing means (222) as 
control data to thereby cause said multiplexing 
means (222) to multiplex said information in a 
preselected position of the output data format. 

1 2. A device as claimed in claim 9, wherein said control 
means (242) further generates information showing 
that scrambling has been executed, and feeds said 
information to said multiplexing means (222) as 
control data to thereby cause said multiplexing 
means (222) to multiplex said information in a 
preselected position of the output data format. 

13. An expansion reproducing device comprising: 

demultiplexing means (402) for receiving a sig- 
nal containing image data and control data 
from said multiplexing means (222) included in 
said compression coding device as claimed in 
claim 1 , and for separating said signal into said 
image data and said control data; 
storing means (404a) for storing the image 
data output from said demultiplexing means; 
decoding means (404,406,408) for decoding 
the image data read out of said storing means 
(404a); and 

control means (428) for controlling said demul- 
tiplexing means (402), said storing means 
(404a) and said decoding means 
(404,406,408) in accordance with the control 
data output from said demultiplexing means 
(402); 

wherein said control means (428) gen- 
erates, when storing the image data output 
from said demultiplexing means (402) in said 
storing means (404a), a control signal for writ- 
ing the image data in an order of slices repre- 
sentative of an individual picture and each 
consisting of a plurality of macroblocks, and 
feeds said control signal to said storing means 
(404a), and generates, when received informa- 
tion contained in the control data and repre- 
sentative of positions of the slices occurred 
before and after scrambling, a control signal for 
reading the image data in the order of the posi- 
tions of the slices occurred before the scram- 
bling, but from the positions of the slices 
occurred after the scrambling, and feeds said 
control signal to said storing means (404a) to 
thereby cause descrambled image data to be 
output from said storing means (404a). 

14. A device as claimed in claim 13, wherein said stor- 
ing means (404a) comprises first and second mem- 
ory means each for storing the image data 
representative of two pictures, and wherein said 
control means (428) causes, while the image data 
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are written to said first memory means, the image 
data to be read out of said second memory means 
or causes, while the image data are written to said 
second memory means, the image data to be read 
out of said first memory means. 5 

15. A device as claimed in claim 13, further comprising 
descramble button circuit means (430) for output- 
ting a descramble command signal, wherein said 
control means (428) outputs said control signal for 10 
descrambling only when said descramble com- 
mand signal is input to said control means (428). 



34 

or causes, while the image data are written to said 
second memory means, the image data to be read 
out of said first memory means. 

18. A device as claimed in claim 16, further comprising 
descramble button circuit means (430) for output- 
ting a descramble command signal, wherein said 
control means (428) outputs said control signal for 
descrambling only when said descramble com- 
mand signal is input to said control means (428). 

19. An expansion reproducing device comprising: 
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16. An expansion reproducing device comprising: 

15 

demultiplexing means (402) for receiving a sig- 
nal containing image data and control data 
from said multiplexing means (222) included in 
said compression coding device as claimed in 
claim 4, and for separating said signal into said 20 
image data and said control data; 
storing means (404a) for storing the image 
data output from said demultiplexing means 
(402); 

decoding means (404,406,408) for decoding 25 
the image data read out of said storing means 
(404a); and 

control means (428) for controlling said demul- 
tiplexing means (402), said storing means 
(404a) and said decoding means ( so 
404,406,408) in accordance with the control 
data output from said demultiplexing means 
(402); 

wherein said control means (428) gen- 
erates, when writing said image data output 35 
from said demultiplexing means (402) in said 
storing means (404a). a control signal for writ- 
ing said image data in an order of slices to be 
received, and feeds said control signal to said 
storing means (404a), and generates, only 40 
when received information representative of 
execution of scrambling and contained in said 
control data output from said demultiplexing 
means (402), a control signal for reading the 
image data in the order of positions of the 45 
slices occurred before the scrambling, but from 
the positions of the slices occurred after the 
scrambling, and feeds said control signal to 
said storing means (404a) to thereby cause 
descrambled image data to be output from said so 
storing means (404a). 

17. A device as claimed in claim 16, wherein said stor- 
ing means (404a) comprises first and second mem- 
ory means each for storing the image data 55 
representative of two pictures, and wherein said 
control means (428) causes, while the image data 

are written to said first memory means, the image 
data to be read out of said second memory means 



demultiplexing means (402) for receiving a sig- 
nal containing image data and control data 
from said multiplexing means (222) included in 
said compression coding device as claimed in 
claim 7, and for separating said signal into said 
image data and said control data; 
storing means (404a) for storing the image 
data output from said demultiplexing means 
(402); 

decoding means (404,406,408) for decoding 
the image data read out of said storing means 
(404a); and 

control means (4278) for controlling said 
demultiplexing means (402), said storing 
means (404a) and said decoding means 
(404,406,408) in accordance with the control 
data output from said demultiplexing means 
(402); 

wherein said controller (428) generates, 
when writing the image data output from said 
demultiplexing means (402) in said storing 
means (404a), a control signal for writing the 
image data in an order of strings of macrob- 
locks to be received, and feeds said control sig- 
nal to said storing means (404a), and 
generates, when received information repre- 
sentative of positions of the strings of macrob- 
locks occurred before and after scrambling and 
a number of macroblocks constituting an indi- 
vidual string and contained in said control data 
output from said demultiplexing means (402), a 
control signal for reading the number of mac- 
roblocks of the individual string in an order of 
the positions of the macroblocks occurred 
before the scrambling, but from the positions 
occurred after the scrambling, and feeds said 
control signal to said storing means (404a) to 
thereby cause descrambled image data to be 
output from said storing means (404a). 

20. A device as claimed in claim 19, wherein said stor- 
ing means (404a) comprises first and second mem- 
ory means each for storing the image data 
representative of two pictures and wherein said 
control means (428) causes, while the image data 
are written to said first memory means, the image 
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data to be read out of said second memory means 
or causes, while the image data are written to said 
second memory means, the image data to be read 
out of said first memory means. 

5 

21. A device as claimed in claim 19, further comprising 
descramble button circuit means (430) for output- 
ting a descramble command signal, wherein said 
control means (428) outputs said control signal for 
descrambling only when said descramble com- 10 
mand signal is input to said control means (428). 

22. An expansion reproducing device comprising: 

demultiplexing means (402) for receiving a sig- 75 
nal containing image data and control data 
from said multiplexing means (222) included in 
said compression coding device as claimed in 
claim 10, and for separating said signal into 
said image data and said control data; 20 
storing means (404a) for storing the image 
data output from said demultiplexing means 
(402); 

decoding means (404,406,408) for decoding 
the image data read out of said storing means 25 
(404a); and 

control means (428) for controlling said demul- 
tiplexing means (402), said storing means 
(404a) and said decoding means 
(404,406,408) in accordance with the control 30 
data output from said demultiplexing means 
(402); 

wherein said control means (428) gen- 
erates, when writing the image data output 
from said demultiplexing means (402) in said 35 
storing means (404a), a control signal for writ- 
ing the image data in an order of strings of 
macroblocks to be received, and feeds said 
control signal to said storing means, and gen- 
erates, only when received information repre- 40 
sentative of execution of scrambling and 
contained in said control data output from said 
demultiplexing means (402), a control signal for 
reading macroblocks of the individual string in 
an order of the positions of the macroblocks 45 
occurred before the scrambling, but from the 
positions occurred after the scrambling, and 
feeds said control signal to said storing means 
(404a) to thereby output descrambled image 
data from said storing means (404a). so 

23. A device as claimed in claim 22, wherein said stor- 
ing means (404a) comprises first and second mem- 
ory means each for storing the image data 
representative of two pictures, and wherein said ss 
control means (428) causes, while the image data 
are written to said first memory means, the image 
data to be read out of said second memory means 

or causes, while the image data are written to said 



second memory means, the image data to be read 
out of said first memory means. 

24. A device as claimed in claim 22, further comprising 
descramble button circuit means (430) for output- 
ting a descramble command signal wherein said 
control means (428) outputs said control signal for 
descrambling only when said descramble com- 
mand signal is input to said control means (428). 
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